Kenaszchuk et al. BMC Medicine 201 1, 9:29 
http://www.biomedcentral.eom/1 741 -701 5/9/29 



BMC Medicine 



RESEARCH ARTICLE Open Access 



Interprofessional simulated learning: short-term 
associations between simulation and 
interprofessional collaboration 

Chris Kenaszchuk 1 *, Kathleen MacMillan 2 , Mary van Soeren 3 and Scott Reeves 1,4,5,6 



Abstract 

Background: Health professions education programs use simulation for teaching and maintaining clinical 
procedural skills. Simulated learning activities are also becoming useful methods of instruction for interprofessional 
education. The simulation environment for interprofessional training allows participants to explore collaborative 
ways of improving communicative aspects of clinical care. Simulation has shown communication improvement 
within and between health care professions, but the impacts of teamwork simulation on perceptions of others' 
interprofessional practices and one's own attitudes toward teamwork are largely unknown. 

Methods: A single-arm intervention study tested the association between simulated team practice and measures 
of interprofessional collaboration, nurse-physician relationships, and attitudes toward health care teams. Participants 
were 154 post-licensure nurses, allied health professionals, and physicians. Self- and proxy-report survey 
measurements were taken before simulation training and two and six weeks after. 

Results: Multilevel modeling revealed little change over the study period. Variation in interprofessional 
collaboration and attitudes was largely attributable to between-person characteristics. A constructed categorical 
variable indexing leadership capacity' found that participants with highest and lowest values were more likely to 
endorse shared team leadership over physician centrality. 

Conclusion: Results from this study indicate that focusing interprofessional simulation education on shared 
leadership may provide the most leverage to improve interprofessional care. 



Background 

Collaboration, communication, and coordination of care 
are limited in traditional health care structures by isolated 
health provider education, regulations under which teams 
practice, and the historic hierarchy in hospital settings 
[1-3]. Professionalism creates turf issues [3,4] and sociali- 
zation by separate education leads to communication gaps 
across professions [5]. Against this background of health 
care tradition, some new initiatives have shown interpro- 
fessional care to contribute to improved staff morale, 
greater patient satisfaction and patient safety, and reduced 
duplication of effort [6]. Hogg et al. [7] reported improved 
patient outcomes when health professionals worked in a 
collaborative manner. In primary care settings, patients 
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with mental health and other chronic disease challenges 
experienced health management improvements when 
teams were involved [8] . Yet transitioning professionals to 
work in interprofessional partnerships to achieve a coordi- 
nated and participatory approach to decision-making 
around health and social outcomes has been the unrea- 
lized goal of interprofessional care [9] . 

Interprofessional education (IPE) can yield beneficial 
outcomes such as improving attitudes, collaborative 
knowledge, and team functioning [10,11]. Teamwork 
training should impart knowledge about teamwork and 
enhance teamwork attitudes [12,13]. Training teams has 
been integrated into interprofessional simulated learning 
activities, such as simulated family conferences [14], 
case based simulations [15], and classroom-based train- 
ing [16,17]. Studies that have used simulation to pro- 
mote IPE have reported short-term impacts suggesting 
improved communication within and between health 
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care professions. The simulation environment provides 
participants the freedom to make mistakes, correct them 
and improve communication and processes of care [18]. 
However, there is limited literature on the effectiveness 
of simulation education that mimics interprofessional 
development processes in workshops for practicing 
health care providers. This is an important gap, because 
most health care professionals devote little time to non- 
clinical education. 

This study investigated short-term associations 
between simulation training and two outcomes: health 
professionals' judgments of interprofessional collabora- 
tion (IPC) and teamwork by other groups, and self- 
reports of attitudes toward working in health care 
teams. We also examined the relationship between 
simulation, leadership capacity, and teamwork attitudes 
because the leadership role is an important concept for 
effective IPC [3,19]. 

A college-based school of health sciences in North 
America developed an eight-hour interprofessional simu- 
lated education workshop to train clinical staff in team- 
based practices. When the workshop began, participants 
received an introduction to the benefits of interprofes- 
sional care and education. Participants were given didactic 
information and experiential learning opportunities. The 
workshop content addressed key aspects of developing 
interprofessional teamwork, such as relational factors 
(hierarchy and professional power), team processes (rou- 
tines and rituals), and organizational change (the ability to 
enact change within the sphere of influence) [[20]:p58]. 
These activities were intended to demonstrate that atti- 
tudes toward interprofessional roles and perspectives affect 
decision making and consultation, collaboration, and 
shared leadership [20-22]. A typical workshop then 
involved participation in two or three different ten-minute 
simulation activities followed by a thirty-minute group 
debriefing session with a facilitator. Breaks and meals were 
provided. At the beginning of each activity, learners 
received a written description of the scenario outlining 
their unique role in the simulation. Participants were 
assigned roles that were different from their real-life pro- 
fessions in order to impart another profession's perspec- 
tive. Each activity contained roles for family members and 
different health care professionals. Some included patient 
roles. The assigned roles reflected the professional groups 
represented in each workshop to ensure that the facilitated 
debrief could explore ideas about professional role 
assumptions and misconceptions. (See Additional File 1: 
The Gift for an example of a simulation scenario). 

Methods 

Design 

This was a single-group, uncontrolled intervention study 
with longitudinal self- and proxy-report survey data 



collection. Self-reports are those that have the self as 
the target of a focal concern. Proxy reports make others 
the target of a focal concern. Twelve training workshops 
were conducted in 2008 in group sizes between five and 
fifteen and were one day in duration. Health care pro- 
fessionals participated in one workshop and were asked 
to complete self- and proxy-report survey instruments 
at three times. Time 1 measures were completed on the 
same day as the simulation session and immediately 
before its commencement. Time 2 measures were com- 
pleted approximately 14 days after Time 1 simulation 
training. Time 3 measures were completed 6 weeks after 
simulation training. Ethics review boards of the lead and 
participating institutions approved the study. 

Participants 

Participants were licensed, regulated health professionals 
practicing in a community hospital near Toronto, 
Canada. Professions represented were physicians, nurses, 
and other regulated health professionals including dieti- 
tians, occupational and physical therapists, pharmacists, 
social workers, speech-language pathologists, and others. 
Participants were recruited through information sessions 
and personal recruitment by an institution-based 
research assistant. Workshop participation was voluntary. 
Honoraria were provided to counteract participation bar- 
riers due to lost office hours or other work commitments. 

Measures 

Dependent variables 

The Nurses' Opinion Questionnaire (NOQ) [23] taps 
important dimensions of interprofessional collaboration. 
In previous work the NOQ was adapted to a new format 
[24] suitable for use with multiple groups of health pro- 
fessionals. The adapted scale presents a new three-factor 
structure and writes items to specify 'target' groups 
appropriate for members of 'rater' groups. Respondents 
self-identified their profession; we aggregated data to 
higher-level groups. This was straightforward for nurses 
and physicians who have common training within their 
professions. Other professions such as occupational and 
physical therapists, pharmacists, and social workers were 
aggregated into a third group, allied health staff. Aggre- 
gating created six rater-target combinations: physicians- 
nurses, physicians-allied health staff, nurses-physicians, 
nurses-allied health staff, allied health staff-physicians, 
and allied health staff-nurses. This is a round robin 
design where respondents are proxy reporters on the 
collaboration behaviors of group targets. Each group is 
also a target of two other groups. The adapted scale is 
called the Interprofessional Collaboration Scale (IPC 
scale). Four response options were available for the 
items: strongly disagree (1), disagree (2), agree (3), and 
strongly agree (4). 
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The Collegial Nurse-Physician Relations Subscale 
of the Nursing Work Index (NWI-NPRS) [25] was 
designed for nurses to report on the quality of nursing 
work relationships with physicians. The four response 
options were the same as those for the IPC scale. The 
IPC and NWI-NPRS items have been provided pre- 
viously [24]. 

Three subscales make up the Attitudes Toward Health 
Care Teams Scale (ATHCTS), measuring self-reported 
attitudes toward collective teamworking in health care 
groups [26]. The subscales contain 21 items addressing 
attitudes toward team value (11 items), attitudes toward 
team efficiency (5 items), and attitudes toward shared 
leadership/physician non-centrality (5 items). Items had 
six response options (disagree/agree x strongly/moder- 
ately/ somewhat) . 
Independent variable 

A composite ordinal-level variable on respondents' lea- 
dership capacity was created from three background 
survey items that had either binary or ordered categori- 
cal response options. At the first survey occasion, items 
requested participants to report whether they provided 
direct patient care (no/yes), managed any other staff 
members (no/yes), and the number of years of post- 
licensure experience they had in the profession (<1, 1-5, 
6-10, >10). One point was assigned for each response 
indicating either no direct patient care, or did manage 
staff, or had >6 years of post-licensure experience. The 
variable's range was 0-3 with higher values indicating 
greater leadership potential. 

Multilevel growth curves 

Systematic change and individual differences in change 
were hypothesized to occur after participation in a train- 
ing workshop. Between- and within-person variation in 
the repeated measures taken on IPC scales, the NWI- 
NPRS, and the ATHCTS were analyzed using multilevel 
growth curves [27] and estimated with SAS PROC 
MIXED 9.1 [28]. All models employed an unstructured 
covariance matrix; were estimated with restricted maxi- 
mum likelihood; and converged and had admissible var- 
iance/covariance components except where noted. 
Group- and grand-mean centering of variables were not 
used. 

Results 

Participant characteristics 

Participants are described in Tables 1 and 2. Character- 
istics are presented for Time 1, prior to simulation 
training. There were 154 health professionals who parti- 
cipated in any of the three survey occasions. Most parti- 
cipants were female, were involved in direct patient 
care, did not have managerial responsibilities, and had 
more than 10 years of post-licensure experience in the 



Table 1 Description of study participants 





Physicians 


Nurses 


Allied 
Health 
Professional 


Profession (any participation Time 
1-Time 3) 


14 


96 


44 


Time 1 


13 


91 


43 


Time 2 


12 


89 


-11 


Time 3 


9 


86 


40 


Characteristics (Time 1) 


% 


% 


% 


Gender 








Female 


27.3 


98.8 


90.5 


Male 


72.7 


1.2 


9.5 


Direct patient care 








Yes 


100.0 


89.2 


93.0 


No 


0.0 


10.8 


7.0 


Manage staff 








Yes 


45.5 


26.0 


16.7 


No 


54.5 


74.0 


83.3 



Experience, yrs 




<1 


9.1 4.8 4.8 


1-5 


27.3 13.2 14.3 


6-10 


9.1 16.9 38.1 


>10 


54.5 65.1 42.8 


Leadership capacity 




0 


9.1 16.9 16.7 


1 


72.7 54.2 64.3 


2 


18.2 21.7 16.7 


3 


0.0 7.2 2.4 


Department 




Oncology 


0.0 5.0 12.5 


Cardiac care 


18.2 42.5 40.0 


Primary care 


54.5 37.5 35.0 


Emergency 


0.0 13.8 7.5 


Other (e.g., medicine) 


27.3 1.2 5.0 


profession. In each professional 


group, most participants 


had one point on leadership capacity and about 20-30% 


had two or three points; the skewness of the distribution 


suggests that the construct has face validity. Approxi- 


mately 75% of physicians, nurses, and allied health 


Table 2 Professional representation in study sample: 


Time 1 participants 




Physicians % Nurses 


% Professional % 


Staff Physician 90.9 Adv Prac Nurse 


6.2 Dietitian 14.6 


Resident 9.1 Charge Nurse 


7.4 Occ Therapist 12.2 


TOTAL 100.0 R.N. 


75.3 Pharmacist 24.4 


R.P.N. 


9.9 Phys Therapist 24.4 


Other 


1.2 Social Worker 12.2 


TOTAL 


100.0 Speech Lang Path 4.9 




Other 7.3 




TOTAL 1 00.0 
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professionals were working in primary care or cardiac 
care units when simulation training began. 

Unconditional means model of IPC and attitude changes 

The first model was a two-level unconditional means 
model with random intercept. This model estimates the 
grand mean of scale scores across all individuals and all 
three survey occasions. It also estimates stability of 
scores across the total 6-week measurement period, as 
shown in Equation 1 in the appendix. When written as 
a composite model, the equations contribute the scale 
grand mean across individuals and occasions (700 )> 
person-specific means (Coi)> an d within-person deviations 
(e,y) from person-specific means. 

The intraclass correlation (ICC) expresses stability of 
scale scores as the magnitude of between-person to 
within-person variation. The variance components from 
Equation 1 provide the between-person variance which 
is divided by the total variance, (cTq/cTq + of). This is the 
proportion of total outcome variance that is 'between' 
persons. Scale results for grand mean scores and ICCs 
appear in Table 3. For IPC scales of communication, 
accommodation, and isolation, results are in ascending 
order according to ICC values for each rater/target 
group combination. The NWI-NPRS was given to 
nurses to evaluate physicians; one row is required in 
Table 3. ATHCTS results for team value, team effi- 
ciency, and shared leadership are in alphabetical order. 

Grand mean scores 

Maximum possible scores for the communication and 
accommodation IPC subcales were both 20. Modeled 
mean scores were slightly higher for accommodation 
than communication. Physicians gave higher scores to 
other groups on IPC scales, and physicians received 
lower ratings from other groups. Both nurses and allied 
professionals judged physicians lowest of their two tar- 
get groups. The IPC isolation subscale and the NWI- 
NPRS had identical maximum possible scores (12). On 
the NWI-NPRS, the mean rating nurses gave to physi- 
cians was 8.3; this was slightly higher than the 7.1 mean 
that nurses gave to physicians on the IPC isolation 
subscale. 

Physicians had the lowest grand mean scores of all 
groups on the ATHCTS subscales. Maximum possible 
scores for team efficiency and shared leadership were 
both 30; modeled grand mean scores were lower for all 
groups on shared leadership than team efficiency. 

Intraclass correlation coefficient 

The ICC values for all subscales, rater/target combina- 
tions, and target groups, were usually greater than .50 
and often approached or exceeded .70 (70% variance 



Table 3 IPC and nurse-physician relations behavior, and 
attitudes to teamwork: Unconditional means model 
results 

Scale Outcome (rater -> Grand ICC (variation that 



target 3 ) Mean is between 

persons) 

Communication (max = 20) 

P^A 13.2 0.27 

P^N 13.6 0.50 

N->A 13.8 0.54 

A^P 12.2 0.56 

A^N 13.9 0.61 

N^P 12.6 0.71 
Accommodation (max = 20) 

P->N 14.9 0.07 

N->A 14.0 0.50 

P->A 14.7 0.53 

A^N 14.4 0.54 

N->P 12.7 0.57 

A->P 13.2 0.69 

Isolation (max = 12) 

P-W\ 8.9 0.40 

Ph>N 9.0 0.41 

N^P 7.1 0.52 

N— >A 8.4 0.56 

A->P 7.2 0.67 

A->N 8.3 0.70 

NWI-NPRS: (N -> P; max = 12) 8.3 0.61 
Team Value b (max = 66) 

All 55.5 0.70 

Allied 56.9 0.70 

Nurses 55.4 0.69 

Physicians 51.6 0.64 
Team Efficiency b (max = 30) 

All 22.3 0.59 

Allied 23.3 0.49 

Nurses 22.0 0.62 

Physicians 21.1 0.54 
Shared Leadership 1 " (max = 30) 

All 18.3 0.70 

Allied 18.3 0.73 

Nurses 18.7 0.69 

Physicians 15.5 0.44 



a N = nurse, A = allied, P = physician; b For Team Value, Team Efficiency, and 
Shared Leadership: 'respondents', not 'raters'. 

between persons, 30% within persons). For most rater/ 
target combinations, over half of the overall scale var- 
iance was at the between-person level. Less than half of 
variance in other-directed IPC ratings and attitudinal 
self reports was at the within-person level over time, 
suggesting that individuals differed about their usual 
levels somewhat less than they differed from each other. 
The exception was with physician raters, who displayed 
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more within-person variation than either nurses or allied 
professionals. The difference can be seen in physicians' 
ratings of both target groups on the IPC communication 
and isolation subscales where ICCs were .27 and .50 for 
communication and .40 and .41 for isolation, and in 
physicians' ratings of nurses' accommodation, where 
ICC was .07. In contrast, for the IPC subscales, highest 
ICC values existed for physician targets of the other two 
rater groups, and for nurses as targets of allied profes- 
sionals. Physicians also had the lowest ICC self-reports 
of endorsing shared leadership, at .44, indicating that 
physicians differed around their mean overall level 
slightly more than they differed from each other. How- 
ever the variance about the overall level for physicians 
was greater than the variances for other groups, which 
were closer to 30% (ICCs of .73 and .69 respectively). 

Unconditional growth and reliability of IPC and attitude 
changes 

The second series of models included a single predictor, 
time. Known as an unconditional growth model, this 
model says that individual i's observed scale score on 
occasion /, F«, deviates by e iy from his or her true 
change trajectory over the three survey occasions. The 
model also estimates inter-individual variation in the 
rates of change (in). The full two-level model is given 
in Equation 2 (see appendix). Residual variances from 
the level- 1 and level-2 models were used to estimate 
two key quantities-the amount of within-person varia- 
tion 'explained' by the addition of time as a level-one 
predictor, and the correlation between initial status 
(before simulation training) and change over time (after 
simulation training). 

Variance explained by time is a pseudo-i? 2 statistic cal- 
culated as shown in Equation 3 in the appendix. The 
population covariance of the level-2 residuals from 
Equation 2, er 01 , quantifies the covariance between true 
initial status and true change on IPC and attitudes 
scores. It can be re-expressed as a correlation coefficient 
by dividing it by the square root of the product of its 

variance components, i.e., " -^o^i - , This is the 

V°o' 3 'i 

population correlation between true initial status and 
true change over three survey occasions. 

Results for rater-target combinations and respondent 
groups are given in Table 4, displayed in ascending 
order according to within-person variance explained by 
time (pseudo-i? for level-1) for each scale/subscale. 
Within-person variance explained by time was low for 
the majority of rater-target combinations on IPC sub- 
scales and the NWI, and for ATHCTS subscales. Apart 
from the value for physicians judging nurses on IPC 



accommodation, which was .51, variance explained was 
usually not greater than .20. Some R values for the 
unconditional growth model were negative. This occurs 
when a model's level-1 predictor increases the within- 
person residual variance, er 2 [29,30]. 

Correlations between initial status and change are 
given in the third column of Table 4. Most correlations 
that could be estimated were negative. Four were statis- 
tically significantly different from zero and large (<-.50). 
Negative correlations indicate that respondents who 
reported lower IPC, NWI, and ATHCTS scores prior to 
simulation training gave higher scores at later survey 
occasions than respondents with higher initial scores. 
Correlations were very large for physician targets on 
IPC isolation with nurses and allied professionals as 
raters (-.78, -1.0). In other words, those originally rating 
physicians as most isolated (giving low scores) reported 
the largest (positive) ratings-changes over time. The 
other statistically significant negative relationships 
between initial status and change were found for nurses 
rating allied professionals (-.54), and for all combined 
respondents on the shared leadership subscale of the 
ATHCTS (-.58). The lone statistically significant positive 
relationship was for allied professionals' responses to the 
team value scale (.91). For allied professionals, gains in 
perceived team value were most likely among those with 
higher initial perceptions of team value. 

In many instances the correlation could not be esti- 
mated. This was always because the variance component 
for the rate of change (er 2 ) could not be calculated. This 
result occurred frequently with physician raters and was 
probably a function of too few observations available for 
analysis. 

Reliability of outcome measures was estimated with 
Cronbach's alpha for each survey occasion. We used a 
structural equation modeling (SEM) framework [31] and 
Mplus 5.2 [32] to derive 95% confidence intervals and 
test the equality of alpha at adjacent survey occasions 
for nurses and allied health professionals. Alpha could 
not be estimated for physician outcomes in the SEM 
setup because models would not converge, likely 
because of small sample sizes. In these instances SAS 
PROC CORR was used. 

Alpha estimates are shown for the three survey occa- 
sions in Table 5. Reliability of shared leadership was 
moderate among nurses and allied health professionals 
and usually low for physicians. Confidence intervals 
were wide, but alpha estimates were not statistically dif- 
ferent. Alpha was lower for team efficiency and poor for 
physicians. Alpha for team value was high for all groups. 
Confidence intervals were narrow. For nurses and allied 
health professionals, alpha increased from one period to 
the next and the differences were statistically significant. 
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Table 4 IPC and nurse-physician relations behavior, and 
attitudes to teamwork: Unconditional growth model 
results 



Table 5 ATHCTS reliabilities, by time and profession 

Respondents 



Scale Outcome (rater -> 
target 3 ) 



Variance explained Correlation: initial 
by time status and true 
change 



Communication 

P->A 
P->N 
A->N 
N^P 
A->P 
N— >A 

Accommodation 

P->A 

A->N 

N^P 

N^A 

A->P 

P->N 

Isolation 

P->N 

P->A 

A->N 

N— >A 

N^P 

A->P 

NWI-NPRS: (N -> P) 
Team Value b 

Physicians 
All 

Allied 
Nurses 
Team Efficiency 1 " 

Nurses 
All 

Physicians 
Allied 
Shared Leadership 13 

Nurses 
All 

Physicians 
Allied 



.03 
.04 
.09 
.17 
.21 
.22 

-.10 
-.02 
.00 
.06 
.08 
.51 

-.08 
-.07 
.03 
.08 
.11 
.1 1 
.01 

-.02 
.09 
.13 
.19 

.00 
.03 
.11 
.19 

.07 



.20 



-.60 
-.34 
-.48 
-.54* 



-.15 
.03 
.28 



-.47 
-.47 
-.78* 
1.00* 



.02 
.91* 
-.21 



-.43 

-.62 

-.71 
-.58* 

_C 

-.34 



a N = nurse, A = allied, P = physician; b For Team Value, Team Efficiency, and 
Shared Leadership: 'respondents', not 'raters'; c Non-estimable (not positive 
definite); *P < .05. 



Linear growth with a person-level covariate 

After fitting the unconditional growth model, we investi- 
gated growth models for ATHCTS subscales as outcome 
measures, specifying variation in intercepts and slopes to 
be related to the covariate, leadership capacity. We 
focused on the ATHCTS because an association with 
attitudes was considered more likely than with 



Scale 


Time 


Physicians 


Nurses 


Allied Health 
Professionals 


Shared 
Leadership 


1 


.72 a 


.70 (.59, .82) c 


.67 (.44, .90) 




i 


,jj [-OU) 


73 t A3 R3\ 
.ID \.Od, .ODj 






3 


.05 a (.70) b 


6? (46 77) 

XJ£- \^X\Jf .11} 


70 (4P> 97) 




i n 


./ Z, .DD 


7C\ 73 

./ U, .ID 


.O/, .OU 






no conv 1 "' 


n.s. 


n s 






3 c; nc; 

.DD, .Uj 


73 £.1 


7fl 
.DO, ./U 






no conv 


n.s. 


n.s. 


Team 
Efficiency 


1 


,31 


.57 (.42, .73) 


r a 1 a 1 ctr\\ 

.64 (.41, .89) 




2 


.06 a 


.63 (.49, .76) 


.61 (.48, .80) 




3 


A7 3 


.65 (.51, .78) 


.56 (.29, .84) 




1/2 


.31, .06 


.57, .63 


.64, .61 






no conv 


n.s. 


n.s. 




2/3 


.06, .47 


.65, .65 


.66, .56 






no conv 


n.s. 


n.s. 


Team Value 


1 


.90" 1 


.86 (.81, .91) 


.79 (.69, .89) 




2 


.95 a 


.95 (.92, .99) 


.93 (.85, 1 .00) 




3 


.87 J 


.99 (.96, 1 .00) 


.97 (.93, 1 .00) 




1/2 


.92, 1.01 
no conv 


.86, .95 


.79, .93 




2/3 


.93, .99 
no conv 


.90, .99 


.85, .97 

* 



a PROC CORR; "alpha if 1 item deleted; 
convergence *P < .05, **P < .01; n.s. = 



c Asymptotic distribution-free CIs; d No 
not significant. 



judgments of others' interprofessional collaboration. The 
two-level growth model is shown in Equation 4 of the 
appendix. Equation 4 stipulates that attitude scores are a 
function of a level- 1 intercept that varies as a function 
of leadership capacity, a within-person residual, and an 
interaction between leadership capacity and time. The 
latter is a cross-level interaction to test for differential 
change with respect to the covariate. Equation 4 also 
contains a random component for the intercept, ctq, per- 
mitting intercepts (initial-status attitudes scores) to vary 
across people. The level-2 equation predicting level-1 
time and the time x leadership interaction, n u = y 10 +y n 
(Leadership) .-, omits the random effect for time that was 
present in the model for unconditional growth (Equation 
2) because experimentation revealed non-convergent 
models which indicated that including the random effect 
would over-complicate the model. 

The model in Equation 4 was estimated for the three 
ATHCTS subscales. Time was entered as a continuous 
variable to produce the linear growth model. These 
models yielded coefficients relating to effects of time, 
leadership, and the time-by-leadership interaction. 
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Among models estimated separately for each subscale 
and profession, only one coefficient for time was statisti- 
cally different from zero at P < .05 (physicians, shared 
leadership subscale). Therefore we tentatively concluded 
that attitudes toward health care teamwork likely did 
not exhibit linear growth in the six-week follow-up. 

The Equation 4 model was re-estimated with time 
specified as a series of dummy variables. Fixed effects 
parameter estimates for the three ATHCTS subscales 
and three professions are reported in Additional File 2: 
Fixed Effects. We do not discuss the results in depth 
here, except to note the inconsistent effect of including 
leadership capacity on pseudo-7? values for differences 
in initial status. When compared with the unconditional 
growth model, adding leadership capacity as a predictor 
had more relevance for explaining variance in initial sta- 
tus on the shared leadership subscale than any other. 
The corollary of this result is taken up in Table 6, 
which reports statistically significant mean score differ- 
ences on pairwise comparisons of leadership capacity for 
ATHCTS subscales and survey occasions. Least squares 
mean scores are given. 

Attitudes toward shared leadership had the largest num- 
ber of significant differences. Initial differences were 
observed for all health professional groups and were 



Table 6 Leadership capacity: statistically significant 
differences of mean scores, by time, ATHCTS subscale, 
and profession 



Comparison Values of 
Leadership Capacity 


Time 1 Time 2 


Time 3 




Shared Leadership 






Physicians (N = 1 1) 




1 0 


15.3,27.0 * 13.2,20.0 


14.7, 17.0 


2 0 


18.5,27.0 * 14.2,20.0 


16.2, 17.0 




Nurses (N = 83) 




1 0 


18.2,21.6* 17.5,20.2 


1 8.4, 20.2 


2 0 


18.1,21.6* 18.2,20.2 


18.7, 20.2 


3 1 


23.0,18.2 * 22.7,17.5 * 


22.4, 18.4 


3 2 


23.0,18.0 * 22.7,18.3 


22.4, 18.7 


Allied Health Professionals (N = 42) 




2 0 


21.0,16.9* 19.6,16.8 


18.7, 16.3 


3 0 


30.0,16.9 * 25.0,16.8 * 


26.0, 1 6.3 * 


3 1 


30.0,18.2 * 25.0,18.2 


26.0, 18.3 * 


3 2 


30.0,21.0 * 25.0,19.6 


26.0, 18.7 




Team Efficiency 






Nurses (N = 83) 




2 0 


21.2,22.9 20.1,23.3 * 


21.5, 22.4 


2 1 


21.2,22.1 20.1,22.4 * 


21.5, 21.6 


3 2 


24.5, 21.2 25.4, 20.1 * 


25.0, 21.5 




Team Value 






Nurses (N = 83) 




3 2 


58.8, 50.9 * 54.8, 53.2 


56.6, 51.5 



*P < .05. 



most apparent for allied health professionals. Two pat- 
terns are evident. First, groups with the maximum value 
on leadership capacity (3) always reported higher endor- 
sement of shared leadership than comparison groups 
with leadership capacity values <3. These differences 
were large among allied health professionals. Second, 
physicians and nurses with leadership capacity values of 
zero had higher shared leadership scores than those 
with greater leadership capacity values. The same gen- 
eral pattern of results was found for attitudes toward 
team efficiency and attitudes toward team value, 
although there were many fewer statistically significant 
differences. 

Very few pre-training score differences were sustained 
over the full post-simulation follow-up period. One 
exception occurred with shared leadership where a few 
initial differences on leadership capacity involving nurses 
and allied health professionals were found again at the 
two-week follow-up, the six-week follow-up, or all three 
occasions. 

Attitudes toward shared leadership can be examined 
informally between professions. The group that had 
strongest endorsement of shared leadership was allied 
health professionals. Nurses had an intermediate posi- 
tion between allied professionals and physicians. Low- 
scoring physicians with leadership values of 1 and 2 
reported scores approximately only half as large as phy- 
sicians reporting higher endorsement of shared leader- 
ship whose leadership capacity values were zero. 

Discussion 

The objective of this study was to investigate short-term 
associations between simulation training and health pro- 
fessionals' judgments of IPC by other groups, and self- 
reports of attitudes toward working in health care 
teams. Simple multilevel models examined initial health 
professional group differences before training and 
between- and within-person change shortly after. 

On IPC factors, physicians gave higher ratings to 
nurses and allied health professionals than they received 
from those groups, a finding consistent with previous 
studies [33-35]. Both nurses and allied health profes- 
sionals rated physicians lowest of the target groups. 
Furthermore, physicians always had the lowest self- 
reported scores on attitudes about the value of teams, 
team efficiency, and shared team leadership. Shared lea- 
dership had the least support of any of the three con- 
structs, and physicians endorsed it the least. Because of 
the pivotal role of physicians in Canadian health care 
[3], this should concern health care managers who may 
wish to implement interprofessional care models for 
patient care delivery. 

The primary questions relating to simulation training 
and the multilevel model concern stability and change, 
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that is, inter-individual differences in change over time. 
Variation in IPC and attitudes scores was largely 
explainable by characteristics differing between persons 
instead of those that changed within persons over time. 
The situation with physicians was somewhat different 
for their IPC scale ratings of others. For physicians 
there was slightly (or substantially) less between-person 
variation than within-person variation. This finding 
could be partially explained by the very small number of 
physicians in the study (N = 14) and consequent greater 
physician homogeneity. 

The models for unconditional growth typically revealed 
negative correlations between IPC and attitude levels 
before simulation training, and subsequent change, but 
few correlations were statistically significant. Lower 
scores on the isolation subscale represented qualitatively 
worse assessments of IPC-related isolation-more isola- 
tion-while higher scores represented less isolation. The 
two correlations for ratings of physicians by nurses and 
allied professionals on isolation were large and negative. 
The negative and statistically significant correlations for 
ratings of physicians suggest that initial assessments of 
high isolation (low scale scores) were followed by positive 
change-less isolation (high scores) post-simulation. On 
this particular facet, physicians may have been indirect 
beneficiaries of nurses' simulation training because the 
trend from pre- to post-simulation training was for 
nurses to perceive physicians as being less isolated over 
time, albeit a brief time. Nurses may have acquired better 
understanding of the physicians' role and perspective. 

Very little within-person variation in IPC and attitudes 
scores was attributable to time. This is understandable 
in light of the brief time that passed between the pre- 
simulation survey occasion and the final occasion six 
weeks later. Studies with longer follow-up periods may 
yield different results. 

Leadership capacity was derived from job characteris- 
tics and entered as a predictor to multilevel models for 
professions and pairwise comparisons of leadership 
capacity. The results suggest the existence of an initial, 
pre-simulation 'bump' in reported support for team- 
work. For most professions and leadership capacity 
comparisons where there were initial differences, the 
differences were not sustained two and six weeks after 
training. In one comparison involving allied health pro- 
fessionals the difference was observed at all three survey 
occasions, although a score decline was still apparent 
even for the high-leadership-capacity individuals. 

The comparison of mean scores for different levels of 
leadership capacity suggests that two 'classes' of leader- 
ship capacity groups exist among the study participants. 
As one might anticipate, higher endorsement of shared 
leadership occurred among nurses and allied health care 
professionals who had at least six years of post-licensure 



experience, managerial obligations, and no direct patient 
care tasks. These individuals placed higher value on 
shared leadership prior to IPC simulation training and 
may have maintained it through the third survey occa- 
sion. A second group-concentrated among physicians 
and nurses who had less than six years experience, no 
managerial responsibilities, and direct patient care 
tasks-expressed greater support for shared leadership 
and team efficiency as well. Although the latter group 
stands in contrast to senior colleagues, its support for 
shared leadership was not sustained. For these physi- 
cians and nurses, continuing institutional or group sup- 
port may help sustain endorsement of interprofessional 
care. The importance of shared leadership for organiza- 
tional change has been discussed and evaluated [22]. 
Reeves et al. [20] integrated it into a model of interpro- 
fessional teamwork using terms such as professional and 
organizational power; the concepts are related in that 
health professionals who feel empowered to influence 
their work processes and improve their work conditions 
are more likely to engage in change [[20]:p59]. 

The study found supportive teamwork attitudes in 
predictable and unconventional places: among partici- 
pants with and without current high-leadership roles, 
respectively. Some may see these individuals as formal 
and informal leaders [36] or leverage repositories for 
future developments in interprofessional care. However, 
the lack of sustained change among younger participants 
suggests that continuing socialization towards shared 
leadership may be necessary [3]. 

Limitations 

The study had several limitations. First, the measurement 
occasions were compressed into a short post-simulation 
period of six weeks. It may not have been reasonable to 
expect to be able to model linear growth of IPC assess- 
ments and teamwork attitudes in this time. Second, profes- 
sional representation in subgroups was unbalanced. There 
were many more nurse participants than others, and very 
few physicians. Generalizability may be limited. Third, 
measurement equivalence of the survey instruments over 
time is unknown and may not exist. This problem is not 
unique to our study. Lack of knowledge of scale equiva- 
lence of repeated measures is a long-standing concern in 
longitudinal research. Finally, the study design cannot sup- 
port strong inferences about the causal role of simulation 
training in changing IPC assessment and attitudes over 
time. While temporal orderings between leadership capa- 
city, simulation training, and outcomes are clear, the study 
did not employ a control/comparison group. 

Conclusions 

For simulation scholars we believe these results may 
undermine confidence in the ability of simulation 



Kenaszchuk et al. BMC Medicine 201 1, 9:29 
http://www.biomedcentral.eom/1 741 -701 5/9/29 



Page 9 of 10 



activities to substantially improve interprofessional atti- 
tudes in the long run. Perceptions held by other health 
professionals and by physicians themselves concerning 
physicians' interprofessional effectiveness may be diffi- 
cult to influence in a positive direction if simulation 
training initiatives are only used intermittently and with- 
out strong institutional support. Perceptions of physi- 
cians' collaborative behaviors in areas of 
communication, accommodation and shared leadership 
are areas of particular concern. The high initial baseline 
endorsement of shared leadership among less-experi- 
enced physicians and nurses and more-experienced 
health professionals may be reason for optimism, but it 
should be recognized that this support declined and 
post-training 'recovery' of support for shared leadership 
was very modest. 

While our position appears contrary to the majority of 
studies concluding that simulation is an effective IPE 
teaching tool, our study's novel characteristics distin- 
guish it from others. For example, the participants were 
active clinicians and not students. The focus of training 
was interprofessional relationships rather than skill- 
based practices, such as resuscitation and emergency 
interventions. Outcomes constructs were measured very 
soon after training with instruments whose psycho- 
metric properties are known. 

Attitudes highly supportive of shared team leadership 
may be a lever that IPE and interprofessional simulation 
interventionists-and health care institutions more 
broadly-can use to engage clinicians in interprofessional 
care. Simulation training programs that are designed to 
promote shared leadership within interprofessional 
training groups should be planned and evaluated. 
Finally, health care institutions should sanction interpro- 
fessional education more widely to support teamwork 
attitudes among their actively practicing advocates and 
proponents. 

Appendix 

Equation 1: 



(1) 



Level 1 : Yy = TToi + where £y ~ N(0, cr £ 2 ) 
Level 2 : jr 0 ; = Yoo + to, where ~ N(0, cr Q 2 ) 
Equation 2: 

Level 1 : Y ti \ = jrn,- + jtu TIMEij + £jj, where ~ eij ~ N(0, cr 2 ) 

(2) 

Level 2 : 7 " >i = 700 + , where fa ~ NIO, r 00 ) and t u ~ N(0, r n ) 

jrii = ym + fii 



Equation 4: 

Level 1 : Yy = 7r 0l - + UPTIME + gy, where ~ N(0, cr 2 ) 

, *0, = Xoo + YoitLEADERSHIP^ + f w , where ~ N(0, a 2 ) (4) 
eve ' n u = no + Yu [LEADERSHIP), 



Additional material 



Additional file 1: The Gift. Example scenario given to all participants; 
designed to promote shared decision making and understanding of 
multiple perspectives. The roles were assigned to participants who did 
not work in the focal profession/position. For example, a nurse would be 
given a social worker role. Within workshop groups, roles were assigned 
only if the profession was represented among the participants. 

Additional file 2: Fixed Effects. Shared Leadership: fixed effects 
estimates for time and leadership capacity, 3 professions. 



Equation 3: 



2 ^(unconditional means model) — ^(unconditional growth model) 
^(unconditional means model) 



(3) 
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